Addressing the Association Between Action Video Game Playing Experience and Visual Search in Naturalistic Multisensory Scenes.

Prior studies investigating the effects of routine action video game play have demonstrated improvements in a variety of cognitive processes, including improvements in attentional tasks. However, there is little evidence indicating that the cognitive benefits of playing action video games generalize from simplified unisensory stimuli to multisensory scenes - a fundamental characteristic of natural, everyday life environments. The present study addressed if video game experience has an impact on crossmodal congruency effects when searching through such multisensory scenes. We compared the performance of action video game players (AVGPs) and non-video game players (NVGPs) on a visual search task for objects embedded in video clips of realistic scenes. We conducted two identical online experiments with gender-balanced samples, for a total of N = 130. Overall, the data replicated previous findings reporting search benefits when visual targets were accompanied by semantically congruent auditory events, compared to neutral or incongruent ones. However, according to the results, AVGPs did not consistently outperform NVGPs in the overall search task, nor did they use multisensory cues more efficiently than NVGPs. Exploratory analyses with self-reported gender as a variable revealed a potential difference in response strategy between experienced male and female AVGPs when dealing with crossmodal cues. These findings suggest that the generalization of the advantage of AVG experience to realistic, crossmodal situations should be made with caution and considering gender-related issues.

Perceived Audio-Visual Simultaneity Is Recalibrated by the Visual Intensity of the Preceding Trial.

A vital heuristic used when making judgements on whether audio-visual signals arise from the same event, is the temporal coincidence of the respective signals. Previous research has highlighted a process, whereby the perception of simultaneity rapidly recalibrates to account for differences in the physical temporal offsets of stimuli. The current paper investigated whether rapid recalibration also occurs in response to differences in central arrival latencies, driven by visual-intensity-dependent processing times. In a behavioural experiment, observers completed a temporal-order judgement (TOJ), simultaneity judgement (SJ) and simple reaction-time (RT) task and responded to audio-visual trials that were preceded by other audio-visual trials with either a bright or dim visual stimulus. It was found that the point of subjective simultaneity shifted, due to the visual intensity of the preceding stimulus, in the TOJ, but not SJ task, while the RT data revealed no effect of preceding intensity. Our data therefore provide some evidence that the perception of simultaneity rapidly recalibrates based on stimulus intensity.

Attention capture by own name decreases with speech compression.

Auditory stimuli that are relevant to a listener have the potential to capture focal attention even when unattended, the listener's own name being a particularly effective stimulus. We report two experiments to test the attention-capturing potential of the listener's own name in normal speech and time-compressed speech. In Experiment 1, 39 participants were tested with a visual word categorization task with uncompressed spoken names as background auditory distractors. Participants' word categorization performance was slower when hearing their own name rather than other names, and in a final test, they were faster at detecting their own name than other names. Experiment 2 used the same task paradigm, but the auditory distractors were time-compressed names. Three compression levels were tested with 25 participants in each condition. Participants' word categorization performance was again slower when hearing their own name than when hearing other names; the slowing was strongest with slight compression and weakest with intense compression. Personally relevant time-compressed speech has the potential to capture attention, but the degree of capture depends on the level of compression. Attention capture by time-compressed speech has practical significance and provides partial evidence for the duplex-mechanism account of auditory distraction.

Continuous psychophysics shows millisecond-scale visual processing delays are faithfully preserved in movement dynamics.

Image differences between the eyes can cause interocular discrepancies in the speed of visual processing. Millisecond-scale differences in visual processing speed can cause dramatic misperceptions of the depth and three-dimensional direction of moving objects. Here, we develop a monocular and binocular continuous target-tracking psychophysics paradigm that can quantify such tiny differences in visual processing speed. Human observers continuously tracked a target undergoing Brownian motion with a range of luminance levels in each eye. Suitable analyses recover the time course of the visuomotor response in each condition, the dependence of visual processing speed on luminance level, and the temporal evolution of processing differences between the eyes. Importantly, using a direct within-observer comparison, we show that continuous target-tracking and traditional forced-choice psychophysical methods provide estimates of interocular delays that agree on average to within a fraction of a millisecond. Thus, visual processing delays are preserved in the movement dynamics of the hand. Finally, we show analytically, and partially confirm experimentally, that differences between the temporal impulse response functions in the two eyes predict how lateral target motion causes misperceptions of motion in depth and associated tracking responses. Because continuous target tracking can accurately recover millisecond-scale differences in visual processing speed and has multiple advantages over traditional psychophysics, it should facilitate the study of temporal processing in the future.

Anodal transcranial direct current stimulation enhances response inhibition and attention allocation in fencers.

Background: The aim of this study is to investigate the acute effects of anodal transcranial direct current stimulation (tDCS) on reaction time, response inhibition and attention in fencers. Methods: Sixteen professional female fencers were recruited, and subjected to anodal tDCS and sham stimulation in the primary motor area (M1) one week apart in a randomized, crossover, single-blind design. A two-factor analysis of variance with repeated measures was used to analyze the effects of stimulation conditions (anodal stimulation, sham stimulation) and time (pre-stimulation, post-stimulation) on reaction time, response inhibition, and attention in fencers. Results: The study found a significant improvement in response inhibition and attention allocation from pre-stimulation to post-stimulation following anodal tDCS but not after sham stimulation. There was no statistically significant improvement in reaction time and selective attention. Conclusions: A single session of anodal tDCS could improve response inhibition, attention allocation in female fencers. This shows that tDCS has potential to improve aspects of an athlete's cognitive performance, although we do not know if such improvements would transfer to improved performance in competition. However, more studies involving all genders, large samples, and different sports groups are needed in the future to further validate the effect of tDCS in improving the cognitive performance of athletes.

Lessons learned from an fMRI-guided rTMS study on performance in a numerical Stroop task.

The Stroop task is a well-established tool to investigate the influence of competing visual categories on decision making. Neuroimaging as well as rTMS studies have demonstrated the involvement of parietal structures, particularly the intraparietal sulcus (IPS), in this task. Given its reliability, the numerical Stroop task was used to compare the effects of different TMS targeting approaches by Sack and colleagues (Sack AT 2009), who elegantly demonstrated the superiority of individualized fMRI targeting. We performed the present study to test whether fMRI-guided rTMS effects on numerical Stroop task performance could still be observed while using more advanced techniques that have emerged in the last decade (e.g., electrical sham, robotic coil holder system, etc.). To do so we used a traditional reaction time analysis and we performed, post-hoc, a more advanced comprehensive drift diffusion modeling approach. Fifteen participants performed the numerical Stroop task while active or sham 10 Hz rTMS was applied over the region of the right intraparietal sulcus (IPS) showing the strongest functional activation in the Incongruent > Congruent contrast. This target was determined based on individualized fMRI data collected during a separate session. Contrary to our assumption, the classical reaction time analysis did not show any superiority of active rTMS over sham, probably due to confounds such as potential cumulative rTMS effects, and the effect of practice. However, the modeling approach revealed a robust effect of rTMS on the drift rate variable, suggesting differential processing of congruent and incongruent properties in perceptual decision-making, and more generally, illustrating that more advanced computational analysis of performance can elucidate the effects of rTMS on the brain where simpler methods may not.

Altered effective connectivity among face-processing systems in major depressive disorder.

BACKGROUND: Neuroimaging studies have revealed abnormal functional interaction during the processing of emotional faces in patients with major depressive disorder (MDD), thereby enhancing our comprehension of the pathophysiology of MDD. However, it is unclear whether there is abnormal directional interaction among face-processing systems in patients with MDD. METHODS: A group of patients with MDD and a healthy control group underwent a face-matching task during functional magnetic resonance imaging. Dynamic causal modelling (DCM) analysis was used to investigate effective connectivity between 7 regions in the face-processing systems. We used a Parametric Empirical Bayes model to compare effective connectivity between patients with MDD and controls. RESULTS: We included 48 patients and 44 healthy controls in our analyses. Both groups showed higher accuracy and faster reaction time in the shape-matching condition than in the face-matching condition. However, no significant behavioural or brain activation differences were found between the groups. Using DCM, we found that, compared with controls, patients with MDD showed decreased self-connection in the right dorsolateral prefrontal cortex (DLPFC), amygdala, and fusiform face area (FFA) across task conditions; increased intrinsic connectivity from the right amygdala to the bilateral DLPFC, right FFA, and left amygdala, suggesting an increased intrinsic connectivity centred in the amygdala in the right side of the face-processing systems; both increased and decreased positive intrinsic connectivity in the left side of the face-processing systems; and comparable task modulation effect on connectivity. LIMITATIONS: Our study did not include longitudinal neuroimaging data, and there was limited region of interest selection in the DCM analysis. CONCLUSION: Our findings provide evidence for a complex pattern of alterations in the face-processing systems in patients with MDD, potentially involving the right amygdala to a greater extent. The results confirm some previous findings and highlight the crucial role of the regions on both sides of face-processing systems in the pathophysiology of MDD.

Flexible processing of distractor stimuli under stress.

Acute stress is assumed to affect executive processing of stimulus information, although extant studies have yielded heterogeneous findings. The temporal flanker task, in which a target stimulus is preceded by a distractor of varying utility, offers a means of investigating various components involved in the adjustment of information processing and conflict control. Both behavioral and EEG data obtained with this task suggest stronger distractor-related response activation in conditions associated with higher predictivity of the distractor for the upcoming target. In two experiments we investigated distractor-related processing and conflict control after inducing acute stress (Trier Social Stress Test). Although the stressed groups did not differ significantly from unstressed control groups concerning behavioral markers of attentional adjustment (i.e., Proportion Congruent Effect), or event-related sensory components in the EEG (i.e., posterior P1 and N1), the lateralized readiness potential demonstrated reduced activation evoked by (predictive) distractor information under stress. Our results suggest flexible adjustment of attention under stress but hint at decreased usage of nominally irrelevant stimulus information for biasing response selection.

Implicit visuospatial sequence representations are accessible in both the practice and the transfer hand.

A serial reaction time task was used to test whether the representations of a probabilistic second-order sequence structure are (i) stored in an effector-dependent, effector-independent intrinsic or effector-independent visuospatial code and (ii) are inter-manually accessible. Participants were trained either with the dominant or non-dominant hand. Tests were performed with both hands in the practice sequence, a random sequence, and a mirror sequence. Learning did not differ significantly between left and right-hand practice, suggesting symmetric intermanual transfer from the dominant to the non-dominant hand and vice versa. In the posttest, RTs were shorter for the practice sequence than for the random sequence, and longest for the mirror sequence. Participants were unable to freely generate or recognize the practice sequence, indicating implicit knowledge of the probabilistic sequence structure. Because sequence-specific learning did not differ significantly between hands, we conclude that representations of the probabilistic sequence structure are stored in an effector-independent visuospatial code.

Exploring the relationship between auditory late latency response and language age in children using cochlear implant.

AIM & OBJECTIVES: The study aimed to compare P1 latency and P1-N1 amplitude with receptive and expressive language ages in children using cochlear implant (CI) in one ear and a hearing aid (HA) in non-implanted ear. METHODS: The study included 30 children, consisting of 18 males and 12 females, aged between 48 and 96 months. The age at which the children received CI ranged from 42 to 69 months. A within-subject research design was utilized and participants were selected through purposive sampling. Auditory late latency responses (ALLR) were assessed using the Intelligent hearing system to measure P1 latency and P1-N1 amplitude. The assessment checklist for speech-language skills (ACSLS) was employed to evaluate receptive and expressive language age. Both assessments were conducted after cochlear implantation. RESULTS: A total of 30 children participated in the study, with a mean implant age of 20.03 months (SD: 8.14 months). The mean P1 latency and P1-N1 amplitude was 129.50 ms (SD: 15.05 ms) and 6.93 µV (SD: 2.24 µV) respectively. Correlation analysis revealed no significant association between ALLR measures and receptive or expressive language ages. However, there was significant negative correlation between the P1 latency and implant age (Spearman's rho = -0.371, p = 0.043). CONCLUSIONS: The study suggests that P1 latency which is an indicative of auditory maturation, may not be a reliable marker for predicting language outcomes. It can be concluded that language development is likely to be influenced by other factors beyond auditory maturation alone.

Abnormal multisensory temporal discrimination in Parkinson's disease.

Cognitive deficits are prevalent in Parkinson's disease (PD), ranging from mild deficits in perception and executive function to severe dementia. Multisensory integration (MSI), the ability to pool information from different sensory modalities to form a combined, coherent perception of the environment, is known to be impaired in PD. This study investigated the disruption of audiovisual MSI in PD patients by evaluating temporal discrimination ability between auditory and visual stimuli with different stimulus onset asynchronies (SOAs). The experiment was conducted with Fifteen PD patients and fifteen age-matched healthy controls where participants were requested to report whether the audiovisual stimuli pairs were temporal simultaneous. The temporal binding window (TBW), the time during which sensory modalities are perceived as synchronous, was adapted as the comparison index between PD patients and healthy individuals. Our results showed that PD patients had a significantly wider TBW than healthy controls, indicating abnormal audiovisual temporal discrimination. Furthermore, PD patients had more difficulty in discriminating temporal asynchrony in visual-first, but not in auditory-first stimuli, compared to healthy controls. In contrast, no significant difference was observed for auditory-first stimuli. PD patients also had shorter reaction times than healthy controls regardless of stimulus priority. Together, our findings point to abnormal audiovisual temporal discrimination, a major component of MSI irregularity, in PD patients. These results have important implications for future models of MSI experiments and models that aim to uncover the underlying mechanism of MSI in patients afflicted with PD.

EEG complexity in emotion conflict task in individuals with psychiatric disorders.

Analyzing EEG complexity may help to elucidate complex brain dynamics in individuals with psychiatric disorders and provide insight into neural connectivity and its relationship with deficits such as emotion-related impulsivity. EEG complexity was calculated through multiscale entropy and compared between a heterogeneous psychiatric patient group and a healthy control group during the emotion conflict resolution task. Twenty-eight healthy adults and ten psychiatric patients were recruited and compared on the multiscale entropy of EEG acquired in the task. Our results revealed a lower multiscale entropy in the psychiatric patient group compared to the healthy group during the task. This decrease in multiscale entropy suggests reduced long-range interaction between the left frontal region and other brain regions during the emotion conflict resolution task among psychiatric patients. Notably, a positive correlation was observed between multiscale entropy and impulsivity measures in the psychiatric patient group, where the higher the EEG complexity during the emotion regulation task, the higher the level of self-reported impulsivity in the psychiatric patients. Such impulsivity was evident in both healthy individuals and psychiatric patients, with healthy individuals showing shorter reaction times on incongruent conditions compared to congruent conditions and psychiatric patients displaying similar reaction times in both conditions, This study highlights the significance of investigating EEG complexity and its potential applications in the transdiagnostic exploration of impulsivity in psychiatric disorders.

The role of mood and arousal in the effect of background music on attentional state and performance during a sustained attention task.

Across two online experiments, this study explored the effect of preferred background music on attentional state and performance, as well as on mood and arousal, during a vigilance task. It extended recent laboratory findings-showing an increase in task-focus and decrease in mind-wandering states with music-to environments with more distractions around participants. Participants-people who normally listen to background music during attention-demanding tasks-completed the vigilance task in their homes both with and without their chosen music and reported their attentional state, subjective arousal, and mood valence throughout the task. Experiment 1 compared music to relative silence and Experiment 2 compared music against the backdrop of continuous noise to continuous noise alone. In both experiments, music decreased mind-wandering and increased task-focus. Unlike in previous laboratory studies, in both experiments music also led to faster reaction times while increasing low-arousal external-distraction states. Importantly, mood and arousal increased with music and were shown to mediate its effects on reaction time and for the first time attentional state, both separately and together. Serial mediation effects were mostly confined to models where mood was entered first and arousal second and were consistent with the mood-arousal account of the impact of background music listening.

High visual salience of alert signals can lead to a counterintuitive increase of reaction times.

It is often assumed that rendering an alert signal more salient yields faster responses to this alert. Yet, there might be a trade-off between attracting attention and distracting from task execution. Here we tested this in four behavioral experiments with eye-tracking using an abstract alert-signal paradigm. Participants performed a visual discrimination task (primary task) while occasional alert signals occurred in the visual periphery accompanied by a congruently lateralized tone. Participants had to respond to the alert before proceeding with the primary task. When visual salience (contrast) or auditory salience (tone intensity) of the alert were increased, participants directed their gaze to the alert more quickly. This confirms that more salient alerts attract attention more efficiently. Increasing auditory salience yielded quicker responses for the alert and primary tasks, apparently confirming faster responses altogether. However, increasing visual salience did not yield similar benefits: instead, it increased the time between fixating the alert and responding, as high-salience alerts interfered with alert-task execution. Such task interference by high-salience alert-signals counteracts their more efficient attentional guidance. The design of alert signals must be adapted to a "sweet spot" that optimizes this stimulus-dependent trade-off between maximally rapid attentional orienting and minimal task interference.

Vergence-Accommodation Conflict: Increased Presbyopia in Virtual Reality.

BACKGROUND: Performance and symptoms in completing a visual search task on a PC monitor and using a head-mounted display (HMD) were compared for different viewing conditions and between users of different ages. PATIENTS AND METHODS: Twenty-three young (M = 30 y, SD = 7 y) and 23 older (M = 52 y, SD = 5 y) participants performed a visual search task presented on a PC monitor. The task was repeated using an HMD for a near and a far virtual viewing distance. Reaction times (RT), detection sensitivity (d'), and symptoms were recorded for the three different viewing conditions. RESULTS: RT and d' were not affected by the viewing condition (p > 0.05). In contrast, symptoms significantly depended on the viewing condition but were, in part, not significantly affected by age. It is interesting to note that although not significant, young participants reported more ocular symptoms than older participants in the near vision task carried out using the HMD. DISCUSSION: HMD increases visual symptoms. However, HMD could be, in part, a remedy to problems when using visual aids for near work, in particular for presbyopes.

Task demand mediates the interaction of spatial and temporal attention.

Psychophysical studies typically test attentional mechanisms in isolation, but in everyday life they interact to optimize human behavior. We investigated whether spatial and temporal attention interact in two orientation discrimination experiments that vary in task demand. We manipulated temporal and spatial attention separately and conjointly with well-established methods for testing each spatial or temporal attention. We assessed sensitivity (d') and reaction time for every combination of spatial and timing cues, each of which was valid, neutral, or invalid. Spatial attention modulated sensitivity (d') and speed (reaction time) across temporal attention conditions. Temporal attention modulated sensitivity and speed under high- but not low- task demands. Furthermore, spatial and temporal attention interacted for the high-demand task. This study reveals that task demand matters; in a simple task spatial attention suffices to improve performance, whereas in a more demanding task both spatial and temporal attention interact to boost performance, albeit in a subadditive fashion.

Neural substrates of the interaction between effort-expenditure reward decision-making and outcome anticipation.

OBJECTIVE: Reward anticipation is important for future decision-making, possibly due to re-evaluation of prior decisions. However, the exact relationship between reward anticipation and prior effort-expenditure decision-making, and its neural substrates are unknown. METHOD: Thirty-three healthy participants underwent fMRI scanning while performing the Effort-based Pleasure Experience Task (E-pet). Participants were required to make effort-expenditure decisions and anticipate the reward. RESULTS: We found that stronger anticipatory activation at the posterior cingulate cortex was correlated with slower reaction time while making decisions with a high-probability of reward. Moreover, the substantia nigra was significantly activated in the prior decision-making phase, and involved in reward-anticipation in view of its strengthened functional connectivity with the mammillary body and the putamen in trial conditions with a high probability of reward. CONCLUSIONS: These findings support the role of reward anticipation in re-evaluating decisions based on the brain-behaviour correlation. Moreover, the study revealed the neural interaction between reward anticipation and decision-making.

Brain morphological changes and functional neuroanatomy related to cognitive and emotional distractors during working memory maintenance in post-traumatic stress disorder.

Post-traumatic stress disorder (PTSD) is associated with abnormalities in the processing and regulation of emotion as well as cognitive deficits. This study evaluated the differential brain activation patterns associated with cognitive and emotional distractors during working memory (WM) maintenance for human faces between patients with PTSD and healthy controls (HCs) and assessed the relationship between changes in the activation patterns by the opposing effects of distraction types and gray matter volume (GMV). Twenty-two patients with PTSD and twenty-two HCs underwent T1-weighted magnetic resonance imaging (MRI) and event-related functional MRI (fMRI), respectively. Event-related fMRI data were recorded while subjects performed a delayed-response WM task with human face and trauma-related distractors. Compared to the HCs, the patients with PTSD showed significantly reduced GMV of the inferior frontal gyrus (IFG) (p < 0.05, FWE-corrected). For the human face distractor trial, the patients showed significantly decreased activities in the superior frontal gyrus and IFG compared with HCs (p < 0.05, FWE-corrected). The patients showed lower accuracy scores and slower reaction times for the face recognition task with trauma-related distractors compared with HCs as well as significantly increased brain activity in the STG during the trauma-related distractor trial was observed (p < 0.05, FWE-corrected). Such differential brain activation patterns associated with the effects of distraction in PTSD patients may be linked to neural mechanisms associated with impairments in both cognitive control for confusable distractors and the ability to control emotional distraction.

Gradient boosted decision trees reveal nuances of auditory discrimination behavior.

Animal psychophysics can generate rich behavioral datasets, often comprised of many 1000s of trials for an individual subject. Gradient-boosted models are a promising machine learning approach for analyzing such data, partly due to the tools that allow users to gain insight into how the model makes predictions. We trained ferrets to report a target word's presence, timing, and lateralization within a stream of consecutively presented non-target words. To assess the animals' ability to generalize across pitch, we manipulated the fundamental frequency (F0) of the speech stimuli across trials, and to assess the contribution of pitch to streaming, we roved the F0 from word token to token. We then implemented gradient-boosted regression and decision trees on the trial outcome and reaction time data to understand the behavioral factors behind the ferrets' decision-making. We visualized model contributions by implementing SHAPs feature importance and partial dependency plots. While ferrets could accurately perform the task across all pitch-shifted conditions, our models reveal subtle effects of shifting F0 on performance, with within-trial pitch shifting elevating false alarms and extending reaction times. Our models identified a subset of non-target words that animals commonly false alarmed to. Follow-up analysis demonstrated that the spectrotemporal similarity of target and non-target words rather than similarity in duration or amplitude waveform was the strongest predictor of the likelihood of false alarming. Finally, we compared the results with those obtained with traditional mixed effects models, revealing equivalent or better performance for the gradient-boosted models over these approaches.

Investigating underlying brain structures and influence of mild and subjective cognitive impairment on dual-task performance in people with Parkinson's disease.

Cognitive impairment can affect dual-task abilities in Parkinson's disease (PD), but it remains unclear whether this is also driven by gray matter alterations across different cognitive classifications. Therefore, we investigated associations between dual-task performance during gait and functional mobility and gray matter alterations and explored whether these associations differed according to the degree of cognitive impairment. Participants with PD were classified according to their cognitive function with 22 as mild cognitive impairment (PD-MCI), 14 as subjective cognitive impairment (PD-SCI), and 20 as normal cognition (PD-NC). Multiple regression models associated dual-task absolute and interference values of gait speed, step-time variability, and reaction time, as well as dual-task absolute and difference values for Timed Up and Go (TUG) with PD cognitive classification. We repeated these regressions including the nucleus basalis of Meynert, dorsolateral prefrontal cortex, and hippocampus. We additionally explored whole-brain regressions with dual-task measures to identify dual-task-related regions. There was a trend that cerebellar alterations were associated with worse TUG dual-task in PD-SCI, but also with higher dual-task gait speed and higher dual-task step-time variability in PD-NC. After multiple comparison corrections, no effects of interest were significant. In summary, no clear set of variables associated with dual-task performance was found that distinguished between PD cognitive classifications in our cohort. Promising but non-significant trends, in particular regarding the TUG dual-task, do however warrant further investigation in future large-scale studies.